Entropy and MDL discretization of continuous variables for Bayesian belief networks
نویسندگان
چکیده
منابع مشابه
Entropy and MDL discretization of continuous variables for Bayesian belief networks
An efficient algorithm for partitioning the range of a continuous variable to a discrete Ž . number of intervals, for use in the construction of Bayesian belief networks BBNs , is presented here. The partitioning minimizes the information loss, relative to the number of intervals used to represent the variable. Partitioning can be done prior to BBN construction or extended for repartitioning du...
متن کاملEntropy and Belief Networks
The product expansion of conditional prob abilities for belief nets is not maximum en tropy. This appears to deny a desirable kind of assurance for the model. However, a kind of guarantee that is almost as strong as max imum entropy can be derived. Surprisingly, a variant model also exhibits the guarantee, and for many cases obtains a higher perfor mance score than the product expansion.
متن کاملEntropy operator for continuous dynamical systems of finite topological entropy
In this paper we introduce the concept of entropy operator for continuous systems of finite topological entropy. It is shown that it generates the Kolmogorov entropy as a special case. If $phi$ is invertible then the entropy operator is bounded with the topological entropy of $phi$ as its norm.
متن کاملUnscented Message Passing for Arbitrary Continuous Variables in Bayesian Networks
Since Bayesian network (BN) was introduced in the field of artificial intelligence in 1980s, a number of inference algorithms have been developed for probabilistic reasoning. However, when continuous variables are present in Bayesian networks, their dependence relationships could be nonlinear and their probability distributions could be arbitrary. So far no efficient inference algorithm could d...
متن کاملBelief networks / Bayesian networks
Introduction In modeling real world tasks, one inevitably has to deal with uncertainty. This uncertainty is due to the fact that many facts are unknown and or simply ignored and summarized. Suppose that one morning you find out that your grass is wet. Is it due to rain, or is it due to the sprinkler? If there is no other information, you can only talk in terms of probabilities. In a probabilist...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Intelligent Systems
سال: 2000
ISSN: 0884-8173,1098-111X
DOI: 10.1002/(sici)1098-111x(200001)15:1<61::aid-int4>3.3.co;2-f